Richard Bellman on the Birth of Dynamic Programming

نویسنده

  • Stuart Dreyfus
چکیده

W follows concerns events from the summer of 1949, when Richard Bellman first became interested in multistage decision problems, until 1955. Although Bellman died on March 19, 1984, the story will be told in his own words since he left behind an entertaining and informative autobiography, Eye of the Hurricane (World Scientific Publishing Company, Singapore, 1984), whose publisher has generously approved extensive excerpting. During the summer of 1949 Bellman, a tenured associate professor of mathematics at Stanford University with a developing interest in analytic number theory, was consulting for the second summer at the RAND Corporation in Santa Monica. He had received his Ph.D. from Princeton in 1946 at the age of 25, despite various war-related activities during World War II—including being assigned by the Army to the Manhattan Project in Los Alamos. He had already exhibited outstanding ability both in pure mathematics and in solving applied problems arising from the physical world. Assured of a successful conventional academic career, Bellman, during the period under consideration, cast his lot instead with the kind of applied mathematics later to be known as operations research. In those days applied practitioners were regarded as distinctly second-class citizens of the mathematical fraternity. Always one to enjoy controversy, when invited to speak at various university mathematics department seminars, Bellman delighted in justifying his choice of applied over pure mathematics as being motivated by the real world’s greater challenges and mathematical demands. Following are excerpts, taken chronologically from Richard Bellman’s autobiography. The page numbers are given after each. The excerpt section titles are mine. These excerpts are far more serious than most of the book, which is full of entertaining anecdotes and outrageous behaviors by an exceptionally human being.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

بهینه یابی مسیر تولید نفت ایران: یک مدل کنترل بهینه برنامه ریزی پویا

In this article we present a dynamic programming model for oil production in Iran. To this end, we represent our model in the form of a Bellman equation in which the function for discounted profit as the objective function is formulated as a Bellman equation, and hence is viewed as a dynamic programming problem.Specifically, in order to show the liquids flow in oil tanks, we use differential eq...

متن کامل

Extracting Dynamics Matrix of Alignment Process for a Gimbaled Inertial Navigation System Using Heuristic Dynamic Programming Method

In this paper, with the aim of estimating internal dynamics matrix of a gimbaled Inertial Navigation system (as a discrete Linear system), the discretetime Hamilton-Jacobi-Bellman (HJB) equation for optimal control has been extracted. Heuristic Dynamic Programming algorithm (HDP) for solving equation has been presented and then a neural network approximation for cost function and control input ...

متن کامل

Solving Optimal Feedback Control of Chinese Population Dynamics by Viscosity Solution Approach

In this paper, the optimal birth feedback control of a McKendrick type age-structured population dynamic system based on the Chinese population dynamics is considered. Adopt the dynamic programming approach, to obtain the Hamilton-Jacobi-Bellman equation and prove that the value function is its viscosity solution. By the derived classical verification theorem, the optimal birth feedback control...

متن کامل

On a New Functional Transform in Analysis: the Maximum Transform by Richard Bellman and William Karush

(1) F(xu x2, • • • , xN) = fi(xi) + f2(x2) + +/N(XN) over the region R defined by xi+x2 + • • • +XN = X> x^O. Under various assumptions concerning the ƒ», this problem can be studied analytically; cf. Karush [ l ; 2] , and it can also be treated analytically by means of the theory of dynamic programming [3]. I t is natural in this connection to introduce a "convolution" of two functions ƒ and g...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Operations Research

دوره 50  شماره 

صفحات  -

تاریخ انتشار 2002